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Abstract 

00 ■ This paper provides an effective uniform rate of metastability (in the sense of Tao) on 

the strong convergence of Halpern iterations of nonexpansive mappings in CAT(O) spaces. 

^^ ■ The extraction of this rate from an ineffective proof due to Saejung is an instance of the 

|r^ ■ general proof mining program which uses tools from mathematical logic to uncover hidden 

computational content from proofs. This methodology is applied here for the first time to 

ri ■ a proof that uses Banach limits and hence makes a substantial reference to the axiom of choice. 
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1 Introduction 
(N. 

CO , This paper applies techniques from mathematical logic to extract an explicit uniform rate of 

f~^ ■ metastability (in the sense of Tao [321 110]) from a recent proof due to Saejung (42j of a strong 

^^ \ convergence theorem for Halpern iterations in the context of CAT(O) spaces. The theorem in 

question has been established originally in the context of Hilbert spaces by Wittmann in the 
important paper |52j and can there be viewed as a strong nonlinear generalization of the classical 
von Neumann mean ergodic theorem. Indeed, Wittmann's theorem says that under suitable 

conditions on a sequence of scalars (A„) in [0,1], including the case A„ := -, the so-called 

Halpern iteration 

xo := x, x„+i := A„+ix + (1 - A„+i)ra;„ 

of a nonexpansive selfmapping T : C ^' C of a bounded closed and convex subset C C X strongly 

converges to a fixed point of T. If T is, moreover, linear and A„ := , then Xn coincides with 

n + 1 

1 " 

the ergodic average > T^x from the mean ergodic theorem. 

n -I- 1 ^-^ 

Since Wittmann's theorem does not refer to any linearity but only to a convexity structure of 
the underlying space X (in order to make sense of the Halpern iteration) it can be formulated in 
the context of hyperboUc spaces and was established by Saejung [32 for the important subclass 
of CAT(O) spaces which play the analogous role in the context of hyperbolic spaces as the Hilbert 
spaces do among all Banach spaces. 

As shown in [3] , even for the (linear) mean ergodic theorem, there, in general, is no computable 
rate of convergence for (x„). The next best thing to achieve, therefore, is a rate of metastability, 



i.e. a bound ^{k,g) such that 

(1) VfceNV.g:N^>N3n<$(fc,.g)Vi,j G [n,n + g{n)] {\\xi - Xj\\ < 2-''). 

There are general logical metatheorems due to the first author [21] and Gerhardy and the 
first author [14] that guarantee the extractability of computable and highly uniform such bounds 
^{k,g) from large classes of (even highly ineffective) proofs. Moreover, these bounds have a 
restricted complexity depending on the principles that are used in the proof rather than merely 
being computable (see [12] for a comprehensive treatment). 

A rate of metastability is an instance of the concept of no-counterexample interpretation that 
was introduced in the context of mathematical logic by Kreisel in the 50 's [23 123: as g may be 
viewed as an attempt to refute the Cauchy property of (x„), the functional $(fc, g) in (1) provides 
a bound on a counterexample n to such a refutation. Note that since g may be an arbitrary 
number theoretic function, the seemingly weaker form 

(2) VkenVg-.N-^EBnenViJ £ [n,n + g{n)] {\\x, ~ Xj\\ <2-'') 

of the Cauchy property actually implies back the full Cauchy property, though only ineffectively 
so. Because of the latter point, the existence of an effective bound on (2) does not contradict the 
aforementioned fact that there is no effective Cauchy rate for (x„) available. 

By the uniformity of the bound $ we refer to the fact that it is independent of the operator 
T, the point a; G C as well as of C and X but only depends - in addition to k and g - on a bound 
on the diameter of C as well as - in the case of general (A„) - certain moduli on (A„). 

Based on the aforementioned logical metatheorems, [5] extracted the first explicit such uniform 
bound $ for the mean ergodic theorem from its usual textbook proof. Subsequently, in [21] the 
current authors extracted such bound for the more general class of uniformly convex Banach spaces 
from a proof due to G. Birkhoff. That bound - when specialized to the Hilbert space setting - 
even turned out to be numerically better than the one from [J. 

In |23j , the first author extracted - making use of a rate of asymptotic regularity due to the 
second author [29j - a rate of metastability of similar complexity for Wittmann's nonlinear ergodic 
theorem (in the Hilbert case). Wittmann's proof is based on weak compactness which, though 
covered by the existing proof mining machinery, in general can cause bounds of extremely poor 
quality. In the case at hand that could be avoided as during the logical extraction procedure the 
use of weak compactness turned out to be eliminable. 

In the present paper, we extract a rate of metastability from Saejung's j42) generalization of 
Wittmann's theorem to the CAT(0)-sctting. In addition to the interest of this specific result, 
our paper is of broader relevance in the proof mining program as it opens up new frontiers for its 
applicability namely to proofs that prima facie use some substantial amount of the axiom of choice. 
This stems from the use of Banach limits made in [42] . The existence of Banach limits is either 
proved by applying the Hahn-Banach theorem to l°° which due to the nonseparability of that space 
needs the axiom of choice, or via ultralimits which, again, needs choice. While weak compactness 
as used in Wittmann's proof at least was in principle covered by existing metatheorems mentioned 
above, this is not the case for Banach limits. Though it seems likely that these metatheorems can 
be extended to incorporate at least basic reasoning with Banach limits as we intend to discuss 
in a different paper, we take the route in this paper to show how to replace the use of Banach 
limits in the present proof by a direct arithmetical reasoning. As the way Banach limits are used 
in the proof at hand seems to be rather typical for other proofs in fixed point theory, our paper 
may also be seen as providing a blueprint for doing similar unwindings in those cases as well. 
Usually, a Banach limit is used to establish the almost convergence in the sense of Lorcntz of 
some sequence (a„) of reals towards a which - together with limsup(a„+i — a„) < - in turn 

n— >oo 

implies that limsup an < a. This line of reasoning goes back to Lorentz' classical paper [31] whose 

relevance in nonlinear ergodic theory was first realized by Reich [55]. In [H], Banach limits are 
used in this way to establish Wittmann's theorem for uniformly Gateaux differentiable Banach 
spaces (under suitable conditions on C). This paper has subsequently been analyzed using the 



method developed in this paper in |25] . Other relavent papers using Banach hmits in the context 
of nonhnear ergodic theory are [H |41] |26] . 

As an intermediate step in proving our main results we also obtain in Section [5] (essentially 
due to the second author in |30| ) a uniform effective rate of asymptotic regularity, i.e. a rate 
of convergence of {d{xn,Txn)) towards 0, which holds in general W-hyperbolic spaces. As this 
bound, in particular, does not depend on x and T, it provides a quantitative version of the main 
result in [1] (see their 'Theorem 3.3'). 

2 Preliminaries 

We shall consider hyperbolic spaces as introduced by the first author [5T]. In order to distinguish 
them from Gromov hyperbolic spaces or from other notions of hyperbolic space that can be found 
in the metric fixed point theory literature (see for example ^9j il5j t40|), we shall call them W- 
hyperbolic spaces. 

A W-hyperbolic space {X, d, W) is a metric space {X, d) together with a mapping W : X x X x 
[0,1] -^ X satisfying 

(Wl) d{z, W{x, y, A)) < (1 - X)d{z, x) + Xd{z, y), 

{W2) d{W{x, y, A), W{x, y, A)) = |A - A| • d{x, y), 

{W3) W{x,y,X) = W{y,x,l~X), 

(WA) d{W{x, z, A), W{y, w, A)) < (1 - X)d{x, y) + Xd{z, w). 

The convexity mapping W was first considered by Takahashi in ^48^ , where a triple {X, d, W) 
satisfying {Wl) is called a convex metric space. We refer to [22l p. 384-387] for a detailed 
discussion. 

The class of M^-hyperbolic spaces includes normed spaces and convex subsets thereof, the 
Hilbert ball (see [TB] for a book treatment) as well as CAT(O) spaces [5]. 

li x,y G X and A G [0, 1], then we use the notation (1 — X)x ® Ay for W{x, y, A). It is easy to 
see that for all x,y € X and A G [0, 1], 

d{x,{l ~ X)x® Xy) ^ Xd{x,y) and d{y,il - X)x ® Xy) = {1 - X)d{x,y). (1) 

Furthermore, Ix (BOy — x, Ox (B ly — y and (1 — X)x (B Xx — Xx (B {I — X)x ~ x. 

For all x,y € X, we shall denote by [x, y] the set {(1 ~ A)a; ® Ay : A G [0, 1]}. A subset C Q X 
is said to be convex if [x, y] Q C for all x,y € C. A nice feature of our setting is that any convex 
subset is itself a VF-hyperbolic space with the restriction of d and W to C. 

Let us recall now some notions on geodesic spaces. Let {X, d) be a metric space. A geodesic 
path, geodesic for short, in X is a map j : [a,b] -^ X which is distance-preserving, that is 

d(7(s),7(t)) = |s-i| for all s,t e [a,b]. (2) 

A geodesic segment in X is the image of a geodesic 7 : [a, 6] — t- X, the points x :— 7(a) and 
y :— 7(6) being the endpoints of the segment. We say that the geodesic segment 7([a, 6]) joins 
X and y. The metric space {X, d) is said to be a (uniquely) geodesic space if every two distinct 
points are joined by a (unique) geodesic segment. It is easy to see that any Ty-hyperbolic space 
is geodesic. 

A CAT(O) space is a geodesic space {X, d) satisfying the so-called CN- inequality of Bruhat-Tits 

[S]: for all x,y,z G X and m G X with d{x, m) = d{y, m) = —d{x, y), 

d{z, mf < ^d{z, x)^ + ^d{z, yf - -^d{x, yf . (3) 

The fact that this definition of a CAT(O) space is equivalent to the usual definition using 
geodesic triangles is an exercise in [SJ p. 163]. Complete CAT(O) spaces are often called Hadamard 



spaces. One can show that CAT(O) spaces are uniquely geodesic and that a normed space is a 
CAT(O) space if and only if it is a pre-Hilbert space. 

CAT(O) spaces can be defined also in terms of Vl^-hyperbolic spaces. 

Lemma 2.1. 122, p. 386-388] Let {X,d) he a metric space. The following are equivalent. 

(i) X is a CAT(O) space. 

(a) There exists a a convexity mapping W such that (A", d, W) is a W -hyperbolic space satisfying 
the CN inequality ^. 

The following property of CAT(O) spaces will be very useful in the following. We refer to [TTl 
Lemma 2.5] for a proof. 

Proposition 2.2. Let {X,d) be a CAT(O) space. Then for all x,y,z e X and A G [0, 1]. 

d'^{{l-X)x®Xy,z) < {l~X)d^{x,z) + Xd^{y,z)~X{l-X)d'^{x,y). (4) 

We recall now some terminology needed for our quantitative results. Let (a„)„>i be a sequence 
of real numbers and a G R. In the following N = {0, 1,2,.. .} and Z+ = {1, 2, . . .}. 

oo 

If the series y. '^n is divergent, then a function 7 : Z+ — ?> Z+ is called a rate of divergence of 

ri=l 
7(") 

the series if \^ a^ > n for all n G Z+. 
fc=i 
If lim a„ = a, then a function 7 : (0, cxd) — > Z+ is said to be a rate of convergence of (a„) if 

n— >oo 

Ve > OVn > 7(e) (|a„ ~ a\ < e) . (5) 

Assume that (a„) is Cauchy. Then 
(i) a mapping 7 : (0, 00) — > Z_|_ is called a Cauchy modulus of (a„) if 

Ve > OVn G N (a^(e)+„ - a^(e) < e) • (6) 

(ii) a mapping ^ : (0, 00) x N^ — s- Z+ is called a rate 0/ metastability of (a„) if 

V£>0Vg:N^N3Ar< *(e,g) Vm,nG [A^, A^ + g(Af)] (|a„-a,„| < e). (7) 

Finally, we say that lim sup a„ < with effective rate 9 : (0, 00) — s> Z+ if 

n— >oo 

Ve>0Vn>6'(e) (a„ < e). (8) 

3 Halpern iterations 

Let C be a convex subset of a normed space X and T : C ^ C nonexpansive. The so-called 
Halpern iteration is defined as follows: 

xo := X, a;„+i := A„+iw + (1 - A„+i)ra;„, (9) 

where (A„)„>i is a sequence in [0, 1], a; G C is the starting point and u G C is the anchor. 
If T is positively homogeneous (i.e. T{tx) = tT{x) for all i > and all x G C), A„ 



n + l 
and M = x, then 

S'nX, where Sqx — x, Sn+ix ^ x + T{Snx). (10) 



n+l 



1 

Furthermore, if T is linear, then a;„ = 7 T'x, so the Halpern iteration could be regarded 

n + 1 ^-^ 

as a nonlinear generalization of the usual Cesaro average. We refer to [5T1 [31] for a a systematic 
study of the behavior of iterations given by pU)) . 

The following problem was formulated by Reich |3H] (see also [25]) and it is still open in its 
full generality. 

Problem 3.1. |23 Problem 6] 

Let X be a Banach space. Is there a sequence (A„) such that whenever a weakly compact convex 
subset C of X possesses the fixed point property for nonexpansive mappings, then (a;„) converges 
to a fixed point of T for all x £ C and all nonexpansive mappings T : C ^ C ? 

Different conditions on (A„) were considered in the literature (see also [JT] for even more 
conditions): 

(CI) lim A„ = 0, 

n— >-oo 

00 

(C2) ^ |A„+i - A„| converges, 

n=l 

00 

(C3) ^ A„ = 00, 



(C4) \[{l-X^)^0, 

and. in the case A„ > for all n > 1, 



n=l 



An, 



[Cb) lim '" /'"^^ = 0, 



(C6) lim ^"^ ""^^ = 0. 

n— >oo A„-|-i 

For sequences A^ in (0, 1), conditions (C3) and (C4) are equivalent. 

Halpern [TB] initiated the study in the Hilbert space setting of the convergence of a particular 
case of the scheme ^. He proved that the sequence (a;„), obtained by taking -u = in ©, 
converges to a fixed point of T for (A„) satisfying certain conditions, two of which are (CI) and 
(C3). P.-L. Lions 32 improved Halpern's result by showing the convergence of the general (a;„) 
if (A„) satisfies (CI), (C3) and (C5). However, both Halpern's and Lions' conditions exclude the 

natural choice Xr, ~ . 

n+1 

This was overcome by Wittmann |52| , who obtained the most important result on the conver- 
gence of Halpern iterations in Hilbert spaces. 

Theorem 3.2. \5'^ Let C be a closed convex subset of a Hilbert space X and T : C -^ C a 

nonexpansive mapping such that the set Fix{T) of fixed points of T is nonempty. Assume that 
(A„) satisfies (CI), (C2) and (C3). Then for any x G C, the Halpern iteration (x„) converges to 
the projection Px of x on Fix(T). 

All the partial answers to Reich's problem require that the sequence (A„) satisfies (CI) and 
(C3). Halpern [181 showed in fact that conditions (CI) and (C3) are necessary in the sense that if, 
for every closed convex subset C of a Hilbert space X and every nonexpansive mappings T : C ^^ C 
such that Fix{T) ^ 0, the Halpern iteration (xn) converges to a fixed point of T, then (A„) must 
satisfy (CI) and (C3). That (CI) and (C3) alone are not sufficient to guarantee the convergence 
of {xn) was shown in |?7]. Recently, Chidume and Chidume [TU] and Suzuki [33] proved that 
if the nonexpansive mapping T in ([9]) is averaged, then (CI) and (C3) suffice for obtaining the 
convergence of (a;„). 

Halpern obtained his result by applying a limit theorem for the resolvent, first shown by 
Browder |5]. This approach has the advantage that the result can be immediately generalized, 
once the limit theorem for the resolvent is generalized. This was done by Reich [3 7) . 



Theorem 3.3. f^7| / Let C be a closed convex subset of a uniformly smooth Banach space X , and 
letT : C ^>- C be nonexpansive such that Fix{T) ^ 0. For each u £ C and t G (0, 1), let z" denote 
the unique fixed point of the contraction mapping 

Tti-) = tu+{l-t)T{-). 

Then lim zY exists and is a fixed point of T . 

A similar result was obtained by Kirk [20] for CAT(O) spaces (for the Hilbert ball, which is 
an example of a CAT(O) space, this is already due to [l^). As a consequence of Theorem 13.31 a 
partial positive answer to Problem 13. II was obtained [37) for uniformly smooth Banach spaces and 

A„ = — — with < a < 1. Furthermore, Reich [39] proved the strong convergence of (a;„) in 

the setting of uniformly smooth Banach spaces that have a weakly sequentially continuous duality 

mapping for general (A„) satisfying (CI), (C3) and being decreasing. Another partial answer in 

the case of uniformly smooth Banach spaces was obtained by Xu [S3j for (A„) satisfying (CI), (C3) 

and (C6) (which is weaker than Lions' (C5)). In [?5, Shioji and Takahashi extended Wittmann's 

result to Banach spaces with uniformly Gateaux differentiable norm and with the property that 

lim zf exists and is a fixed point of T. 
t->-o+ 

4 Main results 

Let T : C — !■ C be a nonexpansive selfmapping of a convex subset C of a W-hyperbolic space 
(AT, d, W). We can define the Halpern iteration in this setting too: 

xo:=x, x„+i := A„+iM® (1 - A„+i)Ta;„, (11) 

where x,u € C and (A„)n>i is a sequence in [0, 1]. 

The following theorem generalizes Wittman's theorem to CAT(O) spaces and was obtained by 
Saejung [32] (as similar result for the Hilbert ball had already been proved in [H]). 

Theorem 4.1. Let C be a closed convex subset of a complete CAT(O) space X and T : C ^ C 
a nonexpansive mapping such that the set Fix(T) of fixed points of T is nonempty. Assume that 
(A„) satisfies (CI), (C2) and (C3). Then for any u,x £ C, the iteration (a;„) converges to the 
projection Pu of u on Fix(T). 

By [201 Theorem 18], Fix{T) 7^ is guaranteed to hold if C is bounded. In this paper we 
only consider this case and our bounds will depend on an upper bound Af on the diameter dc of 
C. However, similar to 23], it is not hard to adopt our bounds to the case where the condition 
M > dc is being replaced by M > d{u,p),d{x,p) for some fixed point p G C oiT. 

The main results of the paper are effective versions of Theorem 14. 1[ obtained by applying proof 
mining techniques to Saejung's proof. As this proof is essentially ineffective and ~ as we discussed 
in the introduction - a computable rate of convergence does not exist, while an effective and 
highly uniform rate of metastability (depending only on the input data displayed in Theorems 14. 21 
14. 3|) is guaranteed to exist (via our elimination of Banach limits from the proof) by [2TJ Theorem 
3.7.3] (note that the conditions on a, 13, 6 as well as T are all purely universal while the conclusion 
3N\/m,n € [N,N + g{N)] {d{xn,Xm) < £) can be written as a purely existential formula and 
that quantification over all (A„) in [0, 1] can be represented as Vj/ < s for some simple function 
s :N2^N). 

Theorem 4.2. Assume that X is a complete CAT(O) space, C ^ X is a closed bounded convex 
subset with diameter dc and T : C ^f C is nonexpansive. Let (A„) satisfy (CI), (C2) and (CS). 
Then the Halpern iteration (xn) is Cauchy. 

n 

Furthermore, let a be a rate of convergence of{Xn), f3 be a Cauchy modulus of Sn := > j-^i+i ^A^j 

CXD 

and 9 be a rate of divergence of > \i+i- 

n=l 



Then for all e £ (0, 2) and g -.N^N, 

3N < E(e, g, M, 9, a, /3) Vm, ne[N,N + g{N)] (d(x„, x™) < e), 

where 

^{e,g,M,e,a,l3) ^ 9+ {r-l+ In 

with M G Z+ such that AI > dc, 



/ 12M 



2\ 1 



1 



£o 



24(M + 1)2 



r = max Xfe(e712) 



1 



Xlie) = $ 



4M(Pfc (e/2) + 1) 



+ Ffc(e/2), Pfe(£) 



<k<f* ° (0) 



12AP{k + l) f e 



$ 



Vl2M(fc+l) 



fl2) 



,„(H£) 



<i>(£,M,0,a,/3)=max{$(|,M,0,/3),a(^)}, 



AUe,g) 






efe(e)=4x^(|)-l + 



In 



3M' 



+ 1, 



9+(n) = niax{0(i) | i < n}, 



f{k) — max 



A'P 



A^(eV4,ff) 
Proo/. See Section [TOl 



fc, r(fc)-/ fc+ 



/*(A:) = fc + r(A:). 



D 



A similar result can be obtained by assuming that (A„) satisfies (CI), (C2) and (C4) with 
corresponding rates. 

Theorem 4.3. Assume that X is a complete CAT(O) space, C '^ X is a closed bounded convex 
subset with diameter dc and T : C ^ C is nonexpansive. Let (A„) satisfy (CI), (C2), (C4) and 
Xn e (0, 1) for all n>2. 

Then the Halpern iteration (x„) is Cauchy. 

n 

Furthermore, if a is a rate of convergence of (A„), /3 is a Cauchy modulus of Sn '■— / l-^j+i ~ ^i\ 

1=1 

oo 

d 6 is a rate of convergence of 1 [ (1 — A„+i) towards 0, then for all e G (0, 2) and g : N — ?► N, 

n=l 

37V < S(e, g, M, 6, a, /3, (A„)) Vm, n G [iV, iV + g{N)] {d(xn,Xm) < e), 



an 



where 

E(e, g, M, 0, a, /?, (A„)) := max lOkieyA) \ 
with M G Z+ such that M > dc. 



<k<p''''"'^'\o) 



(13) 



/3(e/4Af) 

G<D< W (l-A„+i), 



Xfc(e/3)-l 
n=l 

and the other constants and Junctionals being defined as in Theorem \4-^ 

Proof. We use Proposition 16.21 Lemma 15.31 and follow the same line as in the proof of Theorem 
O D 

One can modify Theorems 14.21 H751 so that only metastable versions oi a, f3 and 9 are needed. 
However, we refrain from doing so as the result would be rather unreadable and in the practical 



cases at hand - such as A„ = 



1 



n + 1 



full rates a,l3, are easy to compute. 



1 



Corollary 4.4. Assume that A„ — for all n > 1. Then for all e G (0, 1) and g : N — > N, 

71+1 



where 



with 



3N <j:{s,g,M)ym,ne [N,N + giN)] {d{x„,x^) < e), 



L 

hie) 
xUe) 
Qk{e) 



^{e,g,M) 



/* " (0)- 

12A/2(fc + l) 



-1 



(14) 



48M(fc + 1) 2304A'r (fc + 1)2 



8APiPk{e/2) + l) , 128M4(Pfe (e/2) + 1) 



1 + Pk (e/2) ., 



3M2(x^(£/3) + l) 



-1, 



while the other constants and functionals are defined as in Theorem 

" / 1 \ 2 

Proof Since H ( ^ ^ I~^ 



fc=i 



fc + 2 / n + 2 



we get that 6{e) :— 



2 is a rate of convergence of 



, towards 0. Furthermore, we can take Di. '■= — -, — r^ 

n + 2j Xfc(£/3) + l 



in Theorem 14.31 and 



using CoroUarv 16.31 - $ := ^, $ := vj/ from that corollary. We then get Pk{£), xli^) ^^ above and 

■3M2(x^(e/3) + l)- 



Okie) 



\3My 



The claim now follows by (the proof of ) Theorem 14.31 using that Xk increases with k. 



D 



Despite its superficially quite different look, the bound in Corollary 4.4 has an overall similar 
structure as the bound extracted for the Hilbert space case in [53] : the bound results from applying 



a certain function 0fc(e) to a number k :~ L which is the resuh of an iteration of a function /* 
(starting at some arbitrary value, e.g. 0), where f*(k) is - disregarding many details - something 
close to 8fc(e) + 5(6fe(e)). This is also the structure of the bound in Q^ Theorem 3.3] (where 
A* plays the role of /*). Note that the number of iterations essentially is M^ je^ while it was 
roughly M'^/e^ in the bound in [23, Theorem 3.3]. The main difference, though, is that now O^ 
is significantly more involved compared to [25] (most of its terms stemming from the remains of 
the original Banach- limit argument). 

Remark 4.5. (i) By replacing {X,d) by (X, djv/) with dMix,y) :— — d{x,y) one can always 

arrange that I > dc and then apply the above bounds for 1 instead of M but with s/M 
instead of e to compensate for this rescaling. One then gets a bound in which e and M only 
occur in the form e/M and the number of iterations is (essentially) M'^/e*. However, in 
doing so M would enter the bound at many unnecessary places as well. 

(ii) The assumption on the completeness of X and the closedness of C facilitates the proofs but 
is not necessary in the above results. If the results would fail for an incomplete X then it is 
easy to show that they would fail already for the metric completion X of X and the closure C 
of C in X (since T extends to a nonexpansive operator T : C ^f C). Alternatively, one could 
use directly appropriate approximate fixed points rather than fixed points in the applications 
of Banach 's fixed point theorem in section [5| below. 



(Hi) Subsequently, our results have been further generalized in \43f to the case of unbounded C 
provided that T possesses a fixed point p. Then the above bounds hold with M > diam{C) 
being replaced by M > 4max{d(w, x), d(w,p)}. In JJ3V our method is also adapted to obtain 
similar bounds for more general schemes of so-called modified Halpern iterations. 

5 Quantitative lemmas on sequences of real numbers 

The following lemma about sequences of real numbers was proved in [2] . 

Lemma 5.1. Let (s„) be a sequence of nonnegative real numbers, {an) be a sequence of real 

oo 

numbers in [0, 1] with > a„ = cxd, and (t„) be a sequence of real numbers with limsupi„ < 0. 

-, n— 7-00 

n— 1 

Suppose that 

Sn+i < (1 - a«)s„ + a„i„ for all n > I. 

Then lim s„ — 0. 

We prove now quantitative versions of Lemma l5. 11 which also allow for an error term A. 
Lemma 5.2. Let e e (0,2), g : N ^ N, M e Z+, 6 : Z+ ^ Z+ and i/j : (0, oo) ^ Z+ . Define 

e:=e(£,M,0,V) = ^(v'(|)-i+ iii(v") )+^' ^^^^ 

A:.A(e,,,M,.,^) = 3^^(e .^^(,^3)) , (16) 

where ge{n) = n + g{n + ip{e/3)). 

00 

Assume that («„) is a sequence in [0, 1] such that > «„ = cxd with rate of divergence 9. Let (t„) 

ra=l 

be a sequence of real numbers satisfying 

Vn > V(e/3) (t„ < e/3). (17) 

Let (s„) be a bounded sequence with upper bound M satisfying 

Sn+i < (1 - a„)s„ + antn + A for all n > I. (18) 



Then 

Vne [6,9 + 5(6)] (s„ < e). 

Proof. By induction on m one shows that for ah n > tp{e/3) and tti > 1, 



^n-\-m 



< 



n-\-m—l 

n (1 



7i-\-7rL — 1 



1- n (1-"^) 



(19) 



TO = 1: By (dH) and (HT]), we have that 



s„+i < (1 -a„)s„ + a„t„ + A < (1 -a„)s„ + a„- + A 
= (l-a„)s„ + (l-(l-a„))|+A. 



TO. => 771 + 1 : We have that 

n+rn — 1 

< (1 - a„+,„) 



n (1-"^) 



^n ~r t^i ^n+mj 



n+rn — 1 



1- n (i-"j) 



+ (1 — Q:„+m)TOA + an+mtn+m + A by the induction hypothesis 



< 



n-\-m 



j—n 
i-\-m 



Sn + (1 - ttn+m) 



n+771— 1 



1- n (1-"^) 



]=n 



- + a„+m- + (to + 1)A 



n+771 



1 - an+m - H (1 



a,- + a. 



n+m 



j=n 



- + (m + l)A 



]=n 



n+ra 



1- n(i-"^) 



]=n 



- + (to + 1)A. 

o 



Using the fact that 1 — x < exp(— x) for all x G [0, oo), we get that 

71+7T1 — 1 n+TTi— 1 / n-\-m — l 



n (1 - "j) ^ n exp(-aj) = exp - ^ 



j=n 



j=n 



]=n 



hence 



n+7n— 1 \ / n+rn— 1 

Sn+m < exp - ^ aj s„ + - + mA < cxp - ^ a-j \ M + - + mA (20) 



for aU n > ^{e/3) and ?7i > 1. 

For simphcity, let us denote dm,n '■— Af exp — \^ aj . As in [53], we get that 



n+m— 1 



Ti+rn— 1 



n+m — 1 



dm n < — 'i^ exp — > a, < <^ — > ckj < In ( 

' - 3 ^ ^ ^ I - 3M Z^ J - V3Af 



.3Af/ 



n+m— 1 



\=^J'-M. 



^ E "^^-i-(i|j)=iH— "" ^ "^"-^ 



n+m— 1 n— 1 



Qfj + In 



i=i 



i=i 



(^ 
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Let 



L:=Q- tpie/S) = 6 tlj{e/3) - 1 + 



-m 



+ l-^(£/3). 



(21) 



Since 6* is a rate of divergence of j. "^n and a„ < 1, it is obvious that 6{n) > n for all n > 1, 



hence L > 1. For all to > L, we have that 

ip{e/3)+m-l i/;(e/3) + L-l 

^ a, > ^ «, >V(£/3)-l + 



In 



^) 



i>(e/3)-l 



> J2 "j + 1'^ 



i=i 



^) 



hence 



'^m,jp(e/3) 



< - for all m > L. 



Apply now ((20l) with n := -0(e/3) to get that for all m > L, 

2e 

Let ne [6,9 + 5(6)]. Then 

L < n - ?A(e/3) < 6 + .g(6) - V(e/3) = i + .g(i + VXe/3)) = .9e(i), 
hence we can apply (|22l) with m := n — %jj{e/'i) to get that 

Sn < y + <7e(i)A = e. 



(22) 



D 



It is well-known that for a sequence (q;„) in (0,1) we have that N, a„ = oo if and only if 

n=l 

oo 

11(1 — an) = 0. This suggests a second quantitative version of Lemma 15.11 where, instead of 

n=l 

oo oo 

a rate of divergence for N^ cm, we assume the existence of a rate of convergence of 1 f (1 — Q^n) 

n=l 

towards 0. 

Lemma 5.3. Let e > 0, g : N ^ 'N, M G Z+, D > and 9,11; : (0, oo) ^ Z+. De/^ne 



n=l 



6:=6(e,Af,0,V,i^) = maxW^ 
A:=A{e,g,M,e,iP,D) 



1 



<d 



(23) 
(24) 



3g,(e-^(e/3))' 
where gdn) = n + g{n + ip{e/3)). 

CX) 

Assume that (a„) is a sequence in (0, 1) such that I I (1 — ctn) = with rate of convergence 9. Let 
(t„) he a sequence of real numbers satisfying 

\/n > V'(£/3) {tn < e/3). (25) 

Assume furthermore that 

4'ie/3)-l 

D< Yl (l-a„). (26) 
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Let (s„) be a bounded sequence with upper bound M satisfying 

Sn+i < (1 - a„)s„ + a„t„ + A for all n > 1. 

Then 

Vne [6,9 + 5(6)] (s„ < e). 



(27) 



Proof. We shall denote P„ := 1 I (1 ^ "j) for all n > 1. By convention, Po = 1- We get as in the 
proof of Lemma [521 that for all n > ijj{e/3) and m > 1, 



^n+Ti 



< 



n (1-"^-) 

Hence, for all n > ip{e/Z) and m > 1, 



n+??i— 1 



n+m— 1 



1- n (1-"^) 



- +toA. 

o 



(28) 



-^n+r; 



< 



n+m.— 1 



n (1-"^-) 



MPn+m-l , £ 



s„ + - + mA < 



TTZA. 



n+m — 1 



n (1-"^) 



M + - + mA 



Pn-l 3 

By taking n := ip{e/3), we get that for all m > 1, 



^ip(e/3)+m 



< 



^(£/3)-l 



-+mA. 
o 



Define now 



L:=6-V'(£/3) =: 



KS)- 



^(£/3),0 



(29) 



(30) 



and take n G [6,6 + 5(6)] arbitrary. Then L < n — ip{e/3) < ge{L) and, applying (|29p with 
m := n — ilj{e/3), it follows that 

MP„_i , £ , ^ M/^5^ £ M i?£ . 2e 



Pjp{e/3)-l 3 



-fV(e/3)-l 3 



P^(e/3)-1 3M 3 



0-l>^(xT7)- By (Uni), we get that s„ < £. 



D 



The above lemma turns out to be very useful to get better bounds in the case a„ 



n+1' 



1 / 1 \ 
as > has an exponential rate of divergence, while I I 1 I has a linear rate of 

n—l n—1 ^ ^ 

convergence towards 0. 

Corollary 5.4. Let e (E (0,3), g : 'N ^ N, M e Z+, ^j : (0,oo) -^ Z+. Define 



6:=0(£,M,V) 



3MV'(£/3) 



1, A:=A(£,.g,M,V) 



35e(0-V'(£/3))' 



(31) 



where ge{n) = n + g{n + Tp{e/3)). 

Assume that (t„) is a sequence of real numbers satisfying 

Vji > ^(£/3) (t„ < £/3). 



(32) 
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Let (s„) be a bounded sequence with upper bound M satisfying 

Sn+i < ( 1 ^ ) s„ + ^— 1„ + A for all n > 1. (33) 

\ n + 1 J n+ 1 

Then 

Vne[e,e + 5(e)] (s„<£). (34) 

1 

e 



" / 1 \ 1 

Proof. Remark that for all n > 1, we have that |T ( 1 ) = , hence 9(e) 

-'■-'-V k + 1 J 71+1 

k—l 

is a rate of convergence of 1 [ I 1 I towards 0. Furthermore, we can take D 



_ n+lj ■ ' ■ Tp{e/3) 
in Lemma [5.31 Since e € (0,3), we have that > ^(e/3), hence + 1 > 

£ £ 

ij{£/3). D 

The proof of Lemmas 15.21 15.31 can actually be reformulated to give a full rate of convergence 
for (s„) provided that one does not have the error term A or that A can be made arbitrarily small 
while still keeping -0 and ([T7]) unchanged (note that 8 - in contrast to A - does not depend on g) . 
This error term stems from the fact that we have to eliminate a use of an ineffective arithmetical 
comprehension hidden in forming the limit z of a certain sequence of points (zt^.) which is used in 
Saejung's proof to construct the sequence which plays the role of (t„) in the use of Lemma [521 or 
Lemma [5.31 fsee [3H (2.21)-(2.23)]). Instead of z, we take zt^ where k is sufficiently large so that 
d{zt ■ , z) < £ for all j > k. This error can be incorporated (also when switching from zt^. to Zt for 
j > k) into the error already present in (J17p with some Tpk depending on k but it adds the error 
Aj := IVPtj (see ([721) below compared to [42, (2.21)]), which we provided for in ^E^. The error Aj, 
however, can be made arbitrarily small by increasing j without changing ipk in (|17|) (see the proof 
of the main Theorem 14. 2p . This would give us a rate of convergence in our Theorem 14.21 provided 
that we had a Cauchy rate on (z^^). However, we effectively only get a rate of metastability for this 
sequence (see ProDOsition l9.3l and the discussion preceding this proposition). As a result, k and in 
turn Tpk become dependent on the counterfunction g. This has the consequence that now, via ipk, 
also Q in our application of Lemma 15.21 (in the proof of Theorem 14. 2p becomes dependent on g. 
It is this issue which is responsible for the fact that we only get an effective rate of metastability 
in Theorem 14.21 (rather than a Cauchy rate), which - as discussed in the introduction - in fact is 
best possible. 

The following quantitative lemma is the main ingredient in getting effective rates of asymptotic 
regularity for the Halpern iteration. 

Lemma 5.5. Let (A„)„>i be a sequence in [0,1] and (a„)„>i, (6„)„>i be sequences in M_|_ such 
that for all n > 1, 

an+i < (1 - A„+i)a„ + bn- (35) 

oo n 

Assume that 2^ ^n ^s convergent and j is a Cauchy modulus of Sn '■= / bi. 



(i) If 2^, An+i is divergent with rate of divergence 9, then 

n=l 



whe 



Ve e (0, 2) Vn > $ (a„ < e) , 

(36) 



$ :=$(£, M,0, 7) = 0('7(|)+1+ Inf^) ) 
and M G Z_|_ is an upper bound on (a„). 
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(ii) If Xn e (0, 1) for all n > 2 and I I (1 — A„+i) = with rate of convergence 9, then 



where 



VeG (0,2)Vn>$ (a„ < e) . 



<^ := ^e,M,9,^,D) ^ 9 (-^\ +1, 



M e Z+ is an upper bound on (a„), and 



7(£/2) 



(37) 



(38) 



ra=l 



Proof. (i) Follow the proof of 29, Lemma 9]. 
(ii) The proof of (ii) is basically contained in the proof of [29l Lemma 9] . For sake of completeness 

n 

we give it here. We denote P„ :— TT(1 — Afc+i) for all n > 1. Let e G (0, 2) and define 



fc=i 



Applying [22i Lemma 8] with n := A^, it follows that for all to > 1, 

N+m-l 



(39) 



a-N+r. 



< 



< 



N+m-1 

n (i-^i) 

j=N 

2' 



CAT + ^ hj = 
j=N 



Pn-1 



On 



'7(f)+m ^(f) 



Pi 



N-1 



Let 



X:=$-iV..(^)+l-iV. 



(40) 



Then for all m > L, we have that N + m - 

MPN+m-l 

Pn-1 



^>AS^} 



hence 



Ds e 

< < -. 

- 2Pn-i - 2 



This also implies that L > 1 since, otherwise, 

i<M< ^^P^+^-^ < £ 

- - Pn-1 - 2 
contradicting e G (0,2). Hence the lemma follows. 



D 



6 Effective rates of asymptotic regularity 

The first step towards proving the convergence of the Halpern iterations is to obtain the so-called 
'asymptotic regularity' and this can be done in the very general setting of M^-hyperbolic spaces. 
Asymptotic regularity is a very important concept in metric fixed-point theory, formally in- 
troduced by Browder and Petryshyn in [7j . A mapping T of a metric space (A, d) into itself is 
said to be asymptotically regular if lim d{xn,Txn) ~ for all x G A, where x„ :— T'^x is the 
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Picard iteration starting with x. We shall say that a sequence (j/„) in X is asymptotically regular 
if lim d{yn,Tyn) = 0. A rate of convergence of {d{yn,Tyn))n towards will be called a rate of 

n— ^oo 

asymptotic regularity. 

The following two propositions provide effective rates of asymptotic regularity for the Halpern 
iteration. Proposition 16.11 generalizes to W-hyperbolic spaces a result obtained by the second 
author for Banach spaces [IH]- Proposition 16.21 is new even for the case of Banach spaces. 

Let {X, d, W) be a W-hyperbolic space, C C X be a bounded convex subset with diameter dc, 
T : C — !> C be nonexpansive and {x„) given by pip . 

Proposition 6.1. Assume that (A„) satisfies (CI), (C2) and (C3). Then (a;„) is asymptotically 
regular and lim d{xn, Xn+i) = 0. 

n 

Furthermore, if a is a rate of convergence o/(A„), /3 is a Cauchy modulus of Sn '■= / l-^j+i ^ Ai| 

oo 

and 9 is a rate of divergence of 2^ An+i, then for all e G (0, 2), 

Tl=l 

Vn > $ {d{xn,Xn+i) < e) and Vn > $ {d{xn,Txn) < s) , 



whe 



^KamJ 



$:=$(£, A/, 0,/3) := 

$:=$(£,M,0,a,/3) = max jfl f/S (^) + 1 

with M G Z+ such that M >dc- 
Proof. See Section [71 



,„(f 



1, 



-m 



l,af— ) 
' V4M/ 



(41) 
(42) 

□ 



Thus, we obtain an effective rate of asymptotic regularity $(£, Af, 9, a, /3) which depends only 
on the error e, on an upper bound M on the diameter dc of C, and on (A„) via a, (3,9. In 
particular, the rate $ does not depend on u, x or T, so Proposition 16.11 provides a quantitative 
version of the main theorem in 1. Note that what is called 'property F and 'property S' in [I] 
has been studied under the name of 'axioms (W2) and (W4)' in |21) . 

Proposition 6.2. Assume that A„ G (0, 1) for all n > 2 and that (A„) satisfies (CI), (C2) and 
(C4). Then (x„) is asymptotically regular and lim d(^Xn, Xn+i) — 0. 

n 

Furthermore, if en is a rate of convergence of (A„), /3 is a Cauchy modulus of Sn ■— / \K+i ~ Ai| 

i=l 
oo 

and 9 is a rate of convergence o/ I I (1 — A„+i) — towards 0, then for all e G (0, 2), 
\/n > ^ {d{xn,Xn+i) < e) and Vn > $ {d{xn,Txn) < e) , 



where 



^ie,M,9,l3,D) 
^{e,M,9,a,l3,D) 



\2M 
max < 9 



/ De 



V 4Af 



' V4Af/ 



(43) 
(44) 



/3(£/4M) 



with M G Z+ such that M > dc and < D < Y\ (1 ^ K+i)- 
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Proof. Follow the proof of Proposition 16. 11 applying Lemma [S75] (p!]) instead of Lemma 15751 (p]) . D 



That we even get full rates of convergence in Propositions 16.11 16.21 is due to the fact that the 
original proof of asymptotic regularity is essentially constructive. For such proofs, the requirement 
of the statement to be proved to have the form \/x3y Aqf{x,y) with quantifier- free ^q/, which is 
crucial for ineffective proofs, is not needed (note that the Cauchy property is a V3V-statement). 
This is because we do not have to preprocess the proof using some negative translation (which 
maps proofs with classical logic into ones with constructive logic only) and can directly apply 
proof-theoretic techniques such as (an appropriate monotone form of) Kreisel's so-called modified 
realizability interpretation. Logical metatheorems covering such situations are proved in [1.3_| . As 
a consequence of getting full rates of convergence in Propositions 16.11 16.21 one then also has to 

oo 

strengthen the premises on the convergence of (A„) and ^ | A„+i — A„ | by full rates of convergence 

n=l 

a, p. If we would interpret the proof as an ineffective one using the metatheorems from [21| . then 
one would only get a rate of metastability in the conclusion but also would only need rates of 

oo 

metastability for these premises (note that ^ A„ = oo is a V3-statement so that there is no 
difference here between a full rate and a rate of metastability). 

As an immediate consequence of Proposition 16.21 for A,i = we get a quadratic (in lie) 

n + 1 
rate of asymptotic regularity. For Banach spaces, this rate of asymptotic regularity was obtained 

by the first author in 23 . In [29^ , the second author obtained an exponential rate of asymptotic 

regularity due to the fact that he used the version for Banach spaces of Proposition 16.11 which 

oo -. 

needs a rate of divergence of \^ 



n=l 



Corollary 6.3. Assume that A„ = 



1 



1 



for all n>\. Then for all e G (0, 1), 



Vn > ^(e, Af) {d{xn,Xn+i) < e) and \fn > *(e,A/) (d(x„,Ta;„) < s) , 



where 



*(e,M) := 



2M 

e 



8Ar 



1 and *(e, Af) 



AM 

e 



16Af2 



with M G Z+ such that M >dc- 

1 



Proof. Obviously, lim 
already seen, 9{e 



n— ^oo fi 

2' 

e 



1 



~ with a rate of convergence a{e) — 



1 



(45) 



(46) 



— 2 is a rate of convergence of IT I 1 — 

i-\\ n + 2 

" 1 111 



- 1 > 1. As we have 
towards 0. Furthermore, 



k=l 



k + 1 



It follows easily that lim s 

n— voo 
/3(e/4Af) 

Finally, J] 1 



1/2 with Cauchy modulus /3(e) 



1 



[1/e] - 1 if e > 1/2 
[l/e]-2 ife<l/2' 

2 



e 1 

as — TT < 77, so we can take D := _. , . _ 
4Af 2 [4A///£] 



now Proposition 



n + 2j \AM/e\ 
and use the fact that \x\ < x -1- 1 to get the result 



Apply 
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7 Proof of Proposition 16.1 



The following lemma collects som.e useful properties of Halpern iterations that hold for unbounded 
C too. 

Lemma 7.1. Assume that (a;„) is the Halpern iteration starting with x E C . Then 

(i) For all n > 0, 

d{xn+i,Txn) ^ Xn+id{Txn,u) and d{xn+i,u) ^ {I - Xn+i)d(Txn,u). (47) 

(ii) For all n > 0, 

d{Txn,u) < d{u,Tu) + d{xn,u), (48) 

d{Xn,TXn) < d{Xn+l,Xn) + Xn+ld(TXn,u), (49) 

d{xn+i,u) < {I- Xn+i){d{u,Tu) + d{xn,u)), (50) 

d{Xn+l,Xn) < X„ + ld{Xn,u) + {l- Xn+l)d{TXn,Xn). (51) 

(Hi) For all n > 1, 

d{Xn+l,Xn) < {1- Xn+l)d{Xn,Xn-l) + \Xn+l~ Xn\d{u,TXn~l)- (52) 

(iv) If{xn) is bounded, then (Ta;„) is also bounded. Moreover, if M > d{u,Tu) and M > d{xn,u) 
for all n > 0, 

d{xn,Txn) < d{xn+i,Xn) + 2MXn+i and (53) 

d{x„+i,Xn) < (1 - A„+i)d(x„,x„_i) + 2A/|A„+i - A„| (54) 

for all n > 1. 
Proof (i) By ©. 

(ii) 

d{Txn,u) < d{u,Tu) + d{Tu,Txn) < d{u,Tu) + d{xn,u), 

d{Xn,TXn) < d{Xn+i,Xn) + d{TXn,Xn+l) = d{Xn+l, Xn) + Xn+ld{TXn, u) 
d{Xn+l,u) = {I- Xn+l)d{TXn,u) < {1 - Xn+l){d{u,Tu)+d{Xn,u)) 
d{Xn+l,Xn) < Xn+ld{Xn,u) + {l- Xn+l)d{Xn,TXn) by(Wl). 



(iii) 



d{xn+i,Xn) = d(A„+i?i© (1 - A„+i)ra;„,A„u® (1 - A„)Tx„_i) 

< d{Xr^iu © (l-A,^i)Ta;„, A^iu © (l-A^i)Ta;„_i) 
+d{Xn+iu © (1 - A„+i)ra;„_i, A„u © (1 - A„)Ta;„_i) 

< (1 - Xn+l)d{TXn,TXn^i) + |A„+i - A„ |(i(u, Tx„_i) 
by (W4) and (W2) 

< (1 - Xn+i)d{x„,x„-i) + lA„+i - Xn\d(u,Tx„-i). 



(iv) is an easy consequence of (ii), (iii) 



D 
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In the following, we give the proof of Proposition 16. II 
Let us consider the sequences 



^n ■ — ^l,*^ni '^n— 1 J 5 ^ri 



2Af|A, 



n+l 



A„| 



By dSll), we get that 



a-n+i < (1 - A„+i)a„ + b„ for all n > 1. 

oo 

Moreover, 2_, ^n+i is divergent with rate of divergence 9 and it is easy to see that 



n=l 



7:(0,H^Z+, T,(£) := /3 (-£-) 



is a Cauchy modulus of s„ := > bi 



i=l 



Thus, the hypotheses of Lemma l5.5l (p]) are satisfied, so we can apply it to get that for all 
e e (0, 2) and for all n > l>(e, M, 9, (i) 



where 



dyXji^ Xji^\j \ £, 



(^\ 



(55) 



In 



(f 



$(£,M,^,/3) := 9^p[^—j+l + 
By dnSl), for all n > 2, 

d{Xn-l,TXn^l) < d{Xn,Xn-l) +2MA„. 

Since a is a rate of convergence of (A„) towards 0, we get that 

2MA„ < - for all n > a ( —] . 
2 - \4MJ 



(56) 

(57) 



Combining ([35]), dSH) and ^ it follows that 

d{Xn~l,TXn-l) < e 

for all n > max -^ $ ( - , M, 9, (3) ,a ( ) f j so the conclusion of the theorem follows. 

8 Elimination of Banach limits 

Let us recall that a Banach limit [4] is a linear functional /j, : £°° — >■ R satisfying the following 
properties: 

(i) ti{{xn)) > if a;„ > for all n > 0; 

(ii) /i(l) = 1; 

(iii) niixrij) = ^((x„+i)). 

Here 1 is the sequence (1, 1, . . .) and (xn+i) is the sequence (xi, a;2, . . .). 

As we have already said, to prove the existence of Banach limits one needs the axiom of choice 
(see, e.g., [H]). Banach limits are mainly used in Saejung's convergence proof to get the following: 

Lemma 8.1. /^^/ Let (ak) G i°° and a € R fee such that /i((afe)) < a for all Banach limits /i and 
limsup(afc+i — ak) < 0. Then limsupa/j < a. 



fc— >-oo 



k—^oo 
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Given a sequence {ak)k>i7 consider for all n,p > 1 the following average 



n+p— 1 



CnAM) = - ^ a,. (58) 



I— n 



For simplicity we shall write Cn,p{a,k)- 

Lemma [87T] is proved using a result that goes back to Lorentz [34] . 



Lemma 8.2. Let (0,^) G t°° and a G M. The following are equivalent: 

(i) fi{{ak)) < a for all Banach limits fj,. 

(ii) For all e > there exists P > 1 such that C'n.p{ak) < a + e for all p > P and n > 1. 

In fact, one only needs the implication '(i) =^ (ii)' which is established in [44] using the following 
sublinear functional 

n+p-l 

g : Z°° — 7> K, q{{ak)) '■= limsup sup - \^ Oi — limsup supC„_p(afc). 

p— >oo n>l P ■_ p— foo n>l 

Now fix (cfe) £ l°° and use the Hahn-Banach theorem to show the existence of a linear functional 
/i : ?°° — > K such that n < q and /i((afc)) = q{{ak))- Then fj, is a Banach limit and so - by (i) 
~ liio-k)) — fJ-iio-k)) < a which gives (ii). Our elimination of the use of the Banach limit /x was 
obtained in two steps: first, the proof that - for the sequence in question in the proof from [42J - 
the fact /i((afc)) < a holds for all Banach limits ^ could be modified to directly showing this for 
q instead of /i. This already established the actual elimination of the use of the axiom of choice 
hidden in the application of the Hahn-Banach theorem (for the nonseparable space l°°) since the 
existence of q follows by just using uniform arithmetical comprehension in the form of an operator 
E -.N^ ^ {0, 1} defined by 

Eif) =OoVneN(/(n) = 0), 

that is needed (and sufficient) to form both the 'sup' as well as the 'limsup' in the definition of q 
(as a function in (ok))- Using an argument due to Feferman [12], the use of i? can (over the system 
used to formalize the overall proof) be eliminated in favor of ordinary (non-uniform) arithmetic 
comprehension 

V/ : N^ ^ N 3.9 ; N ^ N Vfc e N {g{k) ^O^VneN {f{k, n) = 0)) , 

which is covered (as a very special case of general comprehension over numbers) by the existing 
logical metatheorems and results in extractable bounds of restricted complexity, namely bounds 
that are definable by primitive recursive functionals in the extended sense of Godel's calculus T 
|17) (which, however, contains the famous so-called Ackermann function), though in general not 
of ordinarily primitive recursive type. 

In order to get a bound having the latter much more restricted complexity we - in a second step 
- also eliminated the use of q in favor of just elementary lemmas on the finitary objects C„.p. In 
the following, rather than going through these two steps separately, we just present the resulting 
elementary lemmas on the averages Cn,p which we will need later. The first lemma collects some 
obvious facts. 

Lemma 8.3. Let (a^), (bk) be sequences of real numbers and a G R. 

(i) If Ok < bk for all k > N , then Cn.p{ak) < Cn.p{bk) for all n > N and p > 1. 

(ii) // Ofc = c G K for all k > N , then Cn,p{ak) ~ c for all n > N and p > 1. 

(Hi) For all n,p > 1, Cn,p{ak + bk) = C„,p(afe) -|- Cn,p{bk) and Cn,p{aak) = aCn,p{ak)- 
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Lemma 8.4. Let (ak) be a sequence of real numbers, a G M and P : (0, cxd) — > Z+ be such that 

Ve > OVn> 1 (C„,p(e)(afc) <a + e). (59) 

Assume that linisup(afe+i — ak) < with effective rate 9. 



k^foo 



Then limsupofc < a with effective rate ip, given by 

k—^oo 



4>ie,p,e) 



p + 1 



p. 



(60) 



where P := P \ —] . 
Proof. By hypothesis, 

and 



C^^piak) < a + 



for all n > 1, 



flfc+l — Ofc < -~ 



P + 1 



for all k > 



Let n > ip{e,P,0). Then n = no + P for some uq > 



P + 1 

e 
P + 1 



We get that for each i 



0,...,P-1, 



On = a 



■na + P 



< flno+i + 



p — flno+i + {o-na+i+l " ^na+i) + (.ana+i+2 - ana+i+l) + . . . + («„„+/> " «„o + P-l) 



(P-i)e 



P+1 

By adding the inequalities, we get that 

Pan < (a„j, + a„Q4-i + 

= (flno + O^riQ + l + 



a 



no+P-l. 



-*no+-P-l. 



(l + 2+... + P)£ 



P+1 



Pe 



hence 



e e 



'J.n < C^^p{ak) + -<a+- + -^a + £. 



2 2 



D 



Lemma 8.5. Assume that (ofe) is nonnegative and lim a^ = 0. T/ick lim Cn,p{o,k) = uniformly 

m n. 

Furthermore, if tp is a rate of convergence of (ak), then for all e G (0, 2), 

Vp > P(e, ^, i) Vn > 1 (C„,p(afc) < e) , 

where 



P{e,ip,L) 
with i G M being an upper bound on (ak). 



'2Lip{e/2)' 



(61) 
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Proof. Let (p,L,e be as in the hypothesis. We shall denote P{e,(p,L) simply by P. Since ip is a 
rate of convergence of (ofe), we have that Ok < - for all k > Lp{e/2). Furthermore, 

^:^(^<| forallp>P. (62) 

Let p > P and n > 1. We have two cases: 
(i) "- > </?(£/2). Then 

n+p-l 

Cn,p{ak) ^ - y^ Q 



1 pe e 



■i^n 



p ^ p 2 2 

(ii) n < ip{e/2). Then 



{ip{e/2)-n)L ^ e ^ (/7(e/2)L , e 



C„,p(afc) <-^ai + - ^ aj< 



n -"^-^ p ^-^ p 2 p 2 



< 



Thus, we have proved that C„_p(afc) < e for all p > P and n > 1. D 

9 Quantitative properties of an approximate fixed point se- 
quence 

In the following, X is a complete CAT(O) space, C C X is a bounded convex closed subset and 
T : C — > C is a nonexpansive mapping. We assume that C is bounded with diameter dc and 
consider M e Z+ with M > dc- 
For t e (0, 1) and m £ C, define 

Tr-C^C, Tny)^tu(B{l-t)Ty. (63) 

It is easy to see that T" is a contraction with contractive constant L := 1—t, so it has a unique 
fixed point z" £ C by Banach's Contraction Mapping Principle. Hence, z" is the unique solution 
of the fixed point equation 

z^ = tw © (1 - t)Tz^. (64) 

Proposition 9.1. Let (y„) be a sequence in C, u d C, t G (0,1), and (z^) be defined by {64^ . 
Define for all n>\ 

7*, := (1 - t)d\u,Tz^) - d^iyn,u). (65) 

(i) For all n > 1, 

d^{yn,z^) < d\yn,u) + ia„ - (1 - t)d\u,Tz^), (66) 

where 

an := d'(y„, ry„) + 2Md(y„, Ty„). (67) 

(ii) If (yn) is asymptotically regular with rate of asymptotic regularity ip, then for all e € (0, 2), 

Vp > Pie, t, M, (^) Vm > 1 {C'mAln) < e) > (68) 

where 



P{e,t,M,ip) 



QAP 



te ^ \QM) 



-LP 



(69) 
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(Hi) Assume that (yn) is asymptotically regular and lim d{yn,yn+i) = 0. Then lira sup 7,^ < 



17* 



Furthermore, if ip is a rate of asymptotic regularity of {Vn), o.nd (p is a rate of convergence 
of {d{yn^yn-\-i)) towards 0, then limsup7^*^ < with effective rate ip, defined by 

n—>oo 

th(e, t, M, w,(2>) ^w( — ——^ ^ ] +P (e/2, i, M , ip) , (70) 

with P given by Ii69\) . 
Proof. For simplicity, we shall denote z" by Zt- 
(i) We get that for all n > 1, 

d^{yn,zt) = d^{yn,tu®{l~t)Tzt) 

< td\yn,u) + (l-t)d^{yn,Tzt)-t(l-t)d^{u,Tzt) by® 

< td^{y,„u) + (1 - t){d{yn,Tyn) + d{Ty^,Tzt)Y - t{l - t)d\u,Tzt) 
by the triangle inequality 

< td\y„,u) + (1 - t){d{yn,Tyn) + d(j/„, Zt)f - t{l - t)d^{u,Tzt) 
by the nonexpansiveness of T 

= td^{yn,u) + (1 -t)d'^{yn,Tyn) + 2(1 - t)d{y„,Tyn)d{yn, Zt) 
+(1 - t)d\yn, Zt) - t{l - t)d^(u,Tzt) 

< td^{yn,u) + (1 - t)d^{yn,Tyn) + 2M(1 - t)d{yn,Tyn) + (1 - t)d'(y„, zt) 
-t{l-t)d^{u,Tzt) 

Thus, for all n > 1, 

td^{yn,zt) < td^{yn,u) + (1 - t)d^{y„,Ty„) + 2M(1 - t)d{y.a,Ty,,) - t{l - t)d^{u,Tzt) 

< td^iyn, u) + d^iyn,Ty„) + 2Md{y„, Ty^) - t{l - t)d\u, Tzt). 

Hence, (|5^ follows, 
(u) Let e e (0, 2). By IHS]), we get that 

< rf'(2/„,M) + -a„ - (1 - t)d^{u,Tzt), 
hence 7^ < - a„ for all n > 1 . It follows by Lemma 18.31 Q that 

Cm,p(7n) < C'm,p ( T "" ) ^'^^' all TO > 1, p > 1. 

Furthermore, lim a„ = lim (d (^/n, rj/„) + 2Af(i(y„, Ty„)) = and, given a rate of asymp- 

n— >oo n— foo 

totic regularity for (y„), we can easily verify that (p I — — ) is a rate of convergence of (a„) 
towards 0. 

Then tp I is a rate of convergence of — a„ towards 0. Since L := is an upper 

^ \3MJ ^ t t ^^ 

bound for (ia„), we can apply Lemma 18.51 for this sequence to conclude that 

Cm^p I —On I < e for all p > P{e, t, M, ip) and to, > 1. (71) 
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(iii) We have that 

|7n+i -7nl = m-t)<f{u,Tzt)-cP{yr,+uu)) - {{l-t)<f{u,Tzt)~d\y^,u))\ 

= \d?{yn,u) -(i^(y„+i,ii)| = \d{yn,u) + d{yn+i,u)\ ■ \d{yn,u) -d{yn+i.,u)\ 
< 2Md{yn,y,i+i)- 

Since hm 2M(i(j/„,y„+i) — 0, we get that 

n— >oo 

hmsup(7^+i -ll) < 0- 

n— >oo 

with effective rate ip ( — — j . Apply ((n]) and Lemma 18.41 to conclude that 



limsup7;<0. (72) 

with effective rate ip{e, t, M, (p, (p). 

n 

Lemma 9.2. Let u,x Cz C and (xn) be the Halpern iteration defined by ill}) . Then for all t G (0, 1) 
and n > 0, 



d^(x„+i,zr) < {I ~ \n+l)d'{Xn,Z^) + Xn+l{ {1 - t)d'iu,Tz'^) - d'{Xn+l,u) ] + M't. (73) 



Proof. 



d^ixn+uz^) < Xn+id^u,z^) + (1 - A„+i)d2(Ta;„,z«) - A„+i(l - Xr,+i)d^{u,Txn) 
by Q applied to d^{xn+i,z^) = d^{\n+iu®{l - K+i)Txn,z^) 
< A„+irf^(M,z") - A„+i(l - Xn+i)d^{u,Txn) + 

+ (1 - A„+i) (td^Txn,u) + (1 - t)d^{Txn,Tz^) - t{l ~ t)d\u, Tz^) 



again by dU applied to d^[Txn, z") = d^{Txn, iw © (1 - t)Tz") 

< A„+id^(M,z") - A„+i(l - Xn+i)d^{u,TXn) + 

+ (1 - A„+i) (td^{TXn,u) + (1 - t)d^{Xn, ZX) - t(l - t)d^{u, T Z^) 



by the nonexpansiveness of T 

= {l-X„+i){l-t)d\xn,Zt) + 

+d^{Txn,u)[ (1 - A„+i)f- A„+i(l - A„+i) ) + 



+A„+i(l - tfd^iu, Tz^) - (1 - A„+i)t(l - t)d^iu,TzX) 
since d(u, z^) = (1 - i)d(M, Tz^") 
(l-A„+i)(l-t)d2(a;„,zr) + 

+A„+i ({1 - t)d^{u,TzX) - (1 - Xn+ifd^{Txn,u) 



+d (ra::„,u)( (1 - A„+i)f - A„+i(l - A„+i) + A„+i(l - A„+i) ) + 
+d^iu,TzX) ( A„+i(l - tf - (1 - A„+i)t(l -t)- A„+i(l - t) 
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= (1 - A„+i)(l - t)d\Xr^,-4) + A„+l ( (1 - t)d'{u,Tz^) - d'iXn+l,u) 

+d^{Txn, u) ft - A„+it + A^+i - Xl+A + d^iu, Tz^){t'' - t) 
since d(xn+i,u) = (1 - A„+i)d(Ta;„,u) 

< (1 - A„+i)(l - t)d^{x,„zf) + A„+i ({l - t)d^u, Tz^) - d^{xn+i,u)\ + 
+td^{Txn,u) 

< {1 - Xn+i)d^x„, z^) + X,,+J {1 - t)d^u,Tz^) - d^{Xn+l,u)] + MH. 



n 

In [B], Browdcr showed that for Hilbert spaces X and z" defined as above one has, for ^ — > 0, the 
strong convergence of z" towards the fixed point of T that is closest to u. Halpern TS gave a much 
more elementary proof of this result. In fact, it follows from his proof that the strong convergence 
of (-z". )fc holds for any nonincreasing sequence (ife) in (0, 1) (while the limit in general will not be 
a fixed point of T unless tk converges towards 0). In [23; . the first author extracted explicit and 
highly uniform rates of metastability from both proofs (again effective rates of convergence are 
ruled out on general grounds, see [23] )■ In [50], Kirk showed that Halpern's proof goes through 
(essentially unchanged) in the context of CAT(O) spaces. Consequently, this also holds for the 
bound extracted from Halpern's proof in [23_ (for the Hilbert ball this is already due to [H]): 

Proposition 9.3. Let (tk) be a nonincreasing sequence in (0, 1). Then for all e > and 5 : N — > N 
the following holds 

3Ko < Kie,g,M)yi,j e [Ko,Ko + giKo)] (d«,<-) < e), 

where 

if(s,5,M):=5^rAfVe^l)(0), (74) 

with g{k) := fc + g{k). 

Proof. For the case of X being a Hilbert space. Proposition 19.31 is proved in f53^. Things extend 
unchanged to the CAT(0)-setting with the same reasoning as in [20 . D 

Remark 9.4. (i) Reasoning as in l23f . Provosition \9.3\ implies the following rate of metasta- 
bility for sequences (tk) that are not necessarily nonincreasing: let (tk)k>o be a sequence 
in (0,1) that converges towards with rate of convergence l3 and x : N — > N 6e defined by 

Xik) = (^[kTi)' hence 

Vfc e NVi > x{k) (ti < -^ 
V fc + 1 

Finally, /et ft- : N — !■ N fee such that tk > i^(k)+i f^^f ^'^ A; G N. Then for all e > and 
5 : N — > N the following holds 

3Ko<K{s,g,M,x)yt,je[Ko,Ko + g{Ko)] {d{zl,z^^) < e), 

where 

K{e,g,M,x,h) := X+l^K*''^''^^ W)' ""'^^ 9ha{k) := max{ft(*) | z < x{k) + gixik))}- 

(a) Instead of a rate of convergence /3 it suffices in '(i) ' above to have a rate of metastability l3g, 
hence a mapping fSg such that 

VfceNVze[/?<,(fc),.g(/3<,(fc))] (t,<-l- 
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10 Proof of Theorem 14.2 



Let £ e (0,2) and g : N — > N be fixed. Let $, $ be as in Proposition 16.11 To make the proof 
easier to read, we sliall omit parameters Af, $, $, 9, a, (3 for all the functionals which appear in the 
following. 
Take 



eo := 



24(M + 1)2 ■ 



Then eo < 1 and 



el + 2Meo + M^eq < eo{M + if < 
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1 



We consider in the sequel t^ :- 

fc + 1 

Denote z" simply by z^ and let 



k 



, with rate of convergence towards given by 7(e) 



(75) 



(76) 

'1 

e 



fc + 1 



(f{u,Tz'ji) — tf{Xn+l,u). 



Thus, 7,^ is defined as in (|55|) by taking t 



k + 1 



and 2/„ := x„+i. 



We can apply Propositions I9.1l ( |iii)) and 16.11 to conclude that limsup7^ < for each k > 0, 

n— foo 

with effective rate Xk, given by 



Xkie) = $ 

Pk{e) = 
For all fc > 0, let us denote 



2Af (Pfc (e) + 1) 
12M2(fc + l)^/ 



Pk (e) , where 



-$ 



Vl2M(fc + l) 



xUe) := Xk{e/2), 

Qkie) :- e>{e,M^e,xl)^e[xUs/3)-l + 

AUe,g) := A{e,g,M^9,xl) 



In 



31VP 



3g,,fc(efe(£)-xI.(e/3))' 
where ge,k{n) = n + g{n + xlis/3)), 9 is defined by ((15]) and A by ^6^. Now let 



/,r :N^N, /(fc):=max 7 



fc -fc, /*(fc):-/(fc + 7(£o))+7(eo). 



AI.(£V4,g) 
Af2 

We can apply Proposition 19.31 for Eq and /* to get the existence of Ki < K{ea,f*) such that 
for allfc,Z e [Ki,Ki + f*{Ki)] 



d{z"„zr)<eo, 
where K is defined by ([71]) . Let 

-ftTo := Ki+-f{eo), 



(77) 



K*(£o,/) := i^(eo,r)+7(£o) = /*'^''''^'°^\0)+7(eo), 



with /*(fc) ■.= k + f*{k). 



25 



Then 7(60) < K^ < K*{eo, f) and it is easy to see, using ([77)1 . that 

Vk, I e [Ko, Ko + f{Ko)] {d{zt,zr) < eo) . (78) 

It follows that for aU fc, I e [Kq, Kq + /{Kq)], 
d\u, Tzl) < {d{u, Tzr) + d{Tzl\ TzDf < d\u, Tzf) + d^Tzlt, Tz^) + 2d{u, Tzlt)d{Tzlt, Tz^) 

< d\u, Tzr) + rf'(^r, 4) + 2Md(zr, z^) 

< d'^{u,Tzr) + el + 2Meo. 

Let 

J:=Ko + f{Ko) = max|7 ( ^"""^^T'^^ ) ,^o| (79) 

Then for all n > 1, 

7n = j^d^{u,Tz:})-d\x^+,,u)<j^{d\u,TzlJ+el + 2Meo)~d^ix,,+i,u) 

< d\u,Tzl^) - d^{xn+i,u) +el + 2Meo 

= j^^d\u,Tz^J-d\x^+uu) + el + 2Meo+j^^d\u,Tz^J 

= 7^ + 4 + 2Mso + j^d'iu, Tz^J < 7^ +el + 2Meo + jt^M' 

Aq + i Aq + i 

< In" +4 + 2Meo + Mho as Kq > 7(^0) 

< ^n" + ^ by®. 

It follows that for aU n > Xk^(£^/12), 

-2 ^2 



„•/ ^ „,A'o 



e e 



7n - /„ ^ 24 - 12- 
Applying ([75)) with t := , we get that for all 71 > 1, 

/J \ 7Vf2 

d^(x„+i,zj) < (l-A„+i)d^(x„,Zj) + A„+i -— — -d^(u,Tzj)-rf^(x„+i,u) + 



(1 - Xn+l)d^{Xn,Z^) + K+lli + 



j + 1 ^ ' ■" ^ "^^' 7 J + 1 

Af2 



J+1 

< (1 - A„+i)d2(x„,z}) + A„+i7;[ + A|,„ (£2/4,3) 

/A|f (eV4,.9)\ 1 A|f (£V4,ff) 

since J > 7 ° ,^„ , hence — < ° , ^„ . It follows that we can apply Lemma 

\ M^ / J+1 M'^ 

Owith £ := £2/4 to conclude that for all n e [N,N + g{N)] 

2 

d^{xn,z'})<—, hence d(x„,z})<-, (80) 

where iV := exo(£2/4). 
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Let now 



-(n) 



max{0(«) I i < n}, 

max{x^(£Vl2) | 7(eo) < k < K*{eo,f)} > Xko(^V12), 
/12AP' 



In 



V" 



1 



In 



In 



fUA'f 
12M^ 



= ex„(eV4) = iv. 

We get finally that N < S(e, g) is such that for all n,m e [N,N + g(N)] 

d[Xn, Xm) ^ u(Xn, Zj) + a[Xjn, Zj) < £. 



(81) 



n 
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